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ABSTRACT 

One  of  the  main  challenges  of  co-simulating  hardware-in-the-loop  systems  in  real¬ 
time  over  the  Internet  is  the  fidelity  of  the  simulation.  The  dynamics  of  the  Internet  may 
significantly  distort  the  dynamics  of  the  network-integrated  system.  This  paper  presents  the 
development  of  an  iterative  learning  control  based  approach  to  improve  fidelity  of  such 
networked  system  integration.  Towards  this  end,  a  new  metric  for  characterizing  fidelity  is 
proposed  first,  which,  unlike  some  existing  metrics,  does  not  require  knowledge  about  the 
reference  dynamics  (i.e.,  dynamics  that  would  be  observed,  if  the  system  was  physically 
connected).  Next,  using  this  metric,  the  problem  of  improving  fidelity  is  formulated  as  an 
iterative  learning  control  problem.  Finally,  the  proposed  approach  is  utilized  in  a  case  study. 
The  conclusion  is  that  the  proposed  approach  can  significantly  improve  the  fidelity  in 
Internet-distributed  hardware-in-the-loop  simulation. 


I.  INTRODUCTION 

The  key  benefit  of  hardware-in-the-loop  (HIL) 
simulation  is  well  known:  it  uniquely  combines 
the  advantages  of  physical  prototyping  and 
simulation-based  engineering  and  thus  allows  for 
experiments  that  are  at  the  same  time  cost 
effective  and  highly  accurate  [1].  It  has  therefore 
become  indispensable  in  many  application  areas, 
such  as  automotive  [2,  3],  aerospace  [4,  5], 


manufacturing  [6],  robotics  [7,  8],  and  defense  [9, 

10]. 

Recently,  Internet-distributed  HIL  simulation 
(ID-HIL)  started  attracting  interest  as  a  framework 
that  enables  concurrent  system  engineering  even  if 
the  components  that  comprise  the  desired  HIL 
setup  are  geographically  distributed.  This  idea  has 
found  applications  in  the  fields  of  earthquake 
engineering  [11-16]  and  automotive  engineering 
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[17-23],  and  is  also  closely  related  to  the 
teleoperation  idea  in  robotics  and  haptics  [24-31]. 

One  of  the  key  challenges  in  ID-HIL 
simulation  is  ensuring  fidelity.  In  this  context, 
fidelity  refers  specifically  to  how  close  the 
dynamics  of  the  networked  system  are  to  the 
dynamics  that  would  be  observed  if  the  system 
was  physically  integrated  (i.e.,  reference 
dynamics).  To  characterize  fidelity,  the  literature 
has  proposed  several  methods.  For  example,  a 
frequency-domain  metric  called  distortion  was 
proposed  as  the  nonnalized  difference  between  the 
networked  and  reference  dynamics  [32,  33],  In 
addition,  the  telerobotics  and  haptics  literatures 
have  proposed  many  other  frequency  domain 
metrics,  which  could  be  adopted  into  the  ID-HIL 
framework,  as  well  [34-39].  A  time-domain, 
statistical  approach  was  also  proposed  to 
distinguish  the  inherent  variation  in  the  reference 
dynamics  from  the  additional  variation  introduced 
due  to  the  network  [20,  23]. 

To  improve  fidelity,  the  literature  proposes 
several  methods,  as  well.  These  methods  range 
from  selecting  appropriate  coupling  points  [32, 
33]  to  using  feedback  control  [40-42]  and 
observer-based  approaches  [17-19].  The 
limitations  of  these  techniques  can  be  briefly 
summarized  as  follows.  Coupling-point-based 
approaches  work  well,  if  a  coupling  point  with 
desired  characteristics  exists.  However,  such  a 
coupling  point  may  not  always  exist.  Feedback- 
based  techniques  are  subject  to  well-known 
fundamental  trade-offs  [41-43];  i.e.,  improving 
fidelity  at  one  frequency  compromises  it  at 
another  frequency.  Observer-based  techniques  rely 
on  the  existence  of  high-fidelity  models.  However, 
not  having  such  models  or  avoiding  the  need  to 
develop  such  models  is  the  main  motivation 
behind  the  HIL  paradigm.  Thus,  improving  fidelity 
in  ID-HIL  systems  is  still  an  open  research 
question  and  is  the  focus  of  this  paper. 

In  an  effort  to  overcome  the  abovementioned 
limitations  of  the  existing  techniques,  this  paper 
proposes  an  iterative  learning  based  approach  to 
improving  fidelity  in  ID-HIL  systems.  First,  a  new 


metric  to  characterize  fidelity  is  proposed.  Unlike 
some  of  the  existing  metrics,  e.g.  [20,  23,  32,  33], 
this  metric  does  not  require  knowledge  about  the 
reference  dynamics  to  quantify  fidelity.  Next,  the 
paper  fonnulates  the  fidelity-improvement 
problem  as  an  iterative  learning  control  problem. 
Finally,  the  proposed  formulation  is  applied  to  an 
ID-HIL  case  study  that  highlights  the  potential 
perfonnance  of  the  proposed  approach. 

II.  CHARACTERIZING  FIDELITY 

As  mentioned  in  Section  I,  many  metrics  have 
been  proposed  to  characterize  fidelity,  especially 
in  telerobotics  and  haptic  systems.  There  are  two 
fundamental  barriers  to  adopting  the  existing 
metrics  to  the  ID-HIL  framework:  (1)  Most  of 
these  metrics  have  been  developed  in  a  linear  and 
detenninistic  framework.  However,  ID-HIL 
systems  are,  in  general,  nonlinear  and  stochastic. 
(2)  Most  of  the  existing  metrics  assume  that  the 
desired  system  dynamics  are  known  and  utilize 
this  knowledge  as  a  benchmark  to  measure  the 
fidelity  of  the  networked  system.  The  benchmark 
for  an  ID-HIL  system  would  be  a  physical 
assembly  of  the  system.  However,  the  main 
motivation  of  the  ID-HIL  paradigm  is  the  lack  of 
availability  of  a  physical  assembly.  Thus,  even 
though  the  existing  metrics  could  still  be  helpful  in 
a  research  environment  where  a  physical  assembly 
could  be  made  available  to  develop  and  test  ID- 
HIL  techniques,  in  practice  the  desired  system 
dynamics  are  unknown  and  most  of  the  existing 
fidelity  metrics  cannot  be  defined. 

Therefore,  the  aim  of  this  section  is  to 
characterize  fidelity  in  an  ID-HIL  system  despite 
the  lack  of  knowledge  about  the  dynamics  that  the 
ID-HIL  system  is  to  emulate  as  accurately  as 
possible.  Towards  this  end,  this  work  uses  the 
error  between  the  instantaneous  values  of  coupling 
signals  at  both  ends  of  the  network. 

To  explain  this  idea  on  an  example,  consider 
the  ID-HIL  framework  shown  in  Fig.  1.  This  is  a 
two-site  ID-HIL  example,  in  which  Systems  1  and 
2,  both  of  which  may  include  hardware  and 
models,  are  integrated  over  a  network  through  the 
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Figure  1:  Illustration  of  defining  the  errors  in  the  coupling 
signals  towards  characterizing  fidelity  in  1D-HIL  on  an 
example  with  two  sites  (System  1  and  2).  ct  .  represents  the 
i-th  coupling  variable  on  the  System  j  side  of  the  network, 
and  ei  represents  the  instantaneous  error  in  the  z'-th  coupling 
variable. 

coupling  variables  cl  and  c2 .  Due  to  the  numerous 
considerations  associated  with  integration  over  a 
network  (e.g.,  network  delays,  communication 
bandwidth,  filters,  sampling,  etc.),  the 
instantaneous  value  of  the  coupling  variable  i  will 
not  be  the  same  on  the  two  sides  of  the  network. 
Let  ct  j(t)  represent  the  value  of  cj  as  seen  by 
System  j  at  time  t .  Ideally,  i.e.,  if  the  systems 
were  co-located  and  coupled  physically,  we  would 
have  c(. ,  (t )  =  ct  2  ( t ) .  In  the  ID-HIL  case,  however, 
the  two  instances  of  the  variable  are  not  the  same, 
i.e.,  ci  X(t)  *  ci  2(t) .  Thus,  we  propose  to  use  the 
difference  between  cn  and  ci2  as  a  metric  for 
fidelity  in  the  coupling  variable  i ;  i.e., 

el(t)  =  cl2(t)-cu(t), 

e2(t)  =  cu(t)-c22(t). 

Note  that  causality  is  taken  into  account  while 
defining  the  error  signals  in  (1)  when  using  the 
system  output  instances  of  the  variables  (i.e.,  cl2 
and  c2  j )  as  the  references  for  the  system  input 
instances  of  the  same  variables  (i.e.,  c, ,  and  c22). 

It  must  also  be  emphasized  that  increasing 
fidelity  of  one  of  the  coupling  signals  does  not 
automatically  imply  an  increase  in  the  fidelity  of 
the  remaining  coupling  signals,  as  shown  in  [32, 
33].  Thus,  in  general,  no  single  coupling  signal 
error  can  completely  describe  the  system  fidelity 
by  itself.  Therefore,  to  increase  the  system  fidelity, 


this  error  needs  to  be  driven  to  zero  for  all 
coupling  variables.  With  respect  to  Fig.  1,  for 
example,  this  implies  .  ex  :=  cx  2  -  cx  x  >  0  and 
e~,  i—  c,  j  —  c2  2  — ^  0 . 

To  characterize  system  fidelity,  all  coupling 
signal  errors  can  be  aggregated  into  a  single  error 
metric.  One  way  to  achieve  this  is  to  use  the 
following  norm  of  weighted  error  norms: 

E  ■=  ^ZWkl)2  •  (2) 

where  n  is  the  total  number  of  coupling  signals. 
The  goal  of  maximizing  the  system  fidelity  then 
translates  to  minimizing  the  system-level  error 
metric  E. 

The  rationale  behind  using  different  weights 
for  different  error  vectors  is  that  the  error  in  one 
coupling  signal  may  be  more  critical  than  the  error 
in  another  for  a  particular  output  of  interest.  In  this 
paper,  we  will  consider  the  weight 


i.e.,  the  norm  of  error  of  each  coupling  variable 
will  be  nonnalized  with  respect  to  its  own  initial 
value. 

III.  IMPROVING  FIDELITY  USING  ITERATIVE 

LEARNING  CONTROL 

The  fundamental  problem  with  the  proposed 
fidelity  metric  is  that  it  is  not  available  online;  i.e., 
the  value  of  cn  and  ci2  at  a  given  instant  cannot 
be  made  available  for  the  error  calculation  at  the 
same  instant.  The  error  ei(t)  can  be  known  only  at 
t  +  r,  i.e.,  after  some  delay  r  that  is  needed  to 
collocate  the  measurements  cn(t)  and  c. 2 (t)  . 
Thus,  the  error  cannot  be  used  without  delay  to 
make  online  corrections  to  improve  fidelity  while 
an  experiment  is  running.  Even  though  the  signal 
could  be  made  available  with  a  delay,  so  that  a 
feedback  loop  could  be  closed  around  it,  since  the 
overarching  goal  of  this  effort  is  to  go  beyond  the 
fundamental  limitations  of  such  feedback 
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methods,  this  option  will  not  be  discussed  any 
further  in  this  paper. 

Instead,  this  work  considers  an  offline 
application  of  the  described  metric  to  improve 
fidelity.  To  achieve  this,  the  iterative  learning 
control  (ILC)  paradigm  is  leveraged  to  improve 
fidelity  of  an  ID-HIL  experiment  iteratively.  The 
rest  of  this  section  describes  this  framework. 

The  ILC-based  framework  used  in  this  work  is 
illustrated  in  Fig.  2  for  one  of  the  coupling  signals 
as  an  example.  The  error  as  defined  in  Eq.  (1)  is 
provided  offline  as  the  error  signal  to  the  ILC 
algorithm.  Together  with  the  control  input  used  in 
the  corresponding  run,  the  algorithm  then  shapes 
the  control  input  according  to  a  learning  algorithm 
to  attenuate  the  error  in  the  next  run,  i.e., 


prevents  the  applicability  of  this  trivial  solution. 
For  example,  referring  to  the  example  in  Fig.  2, 
any  modification  to  c"\"(k)  will  propagate 
through  System  1,  Network,  and  System  2  and 
affect  <'2+l (n),  n  =  k  +  \,k  +  2,...,N  .  In  other 
words,  if  q  2  is  regarded  as  a  reference  for  c, ,  in 
the  ILC  framework,  then  the  problem  can  be 
considered  as  the  reference  signal  changing  as  a 
result  of  the  ILC  action. 

Thus,  designing  the  learning  function 
properly  is  crucial.  Different  learning 
functions  could  be  considered  for  their  suitability 
to  ID-HIL.  In  this  paper,  the  ILC  learning 
algorithm  of  the  fonn 

<+1  (*)  =  Q(q)(<  ( k)  +  L(q)e’?  (k  +  l))  (6) 


ur+l=f(u:,er),  (4) 

with 

u"=k"(0)  «,"( 1)  ...  <(A0]r, 

(5) 

e"  =[e/(0)  e"(l)  -  <(i V)]  . 

where  the  superscript  m  is  an  index  for  the 
iteration,  and  N  represents  the  number  of  time 
steps. 

It  is  very  important  to  emphasize  here  that  this 
problem  is  not  as  trivial  as  using  the  error  from  the 
initial  run  and  adding  it  to  the  coupling  variable  in 
the  current  run.  The  reason  is  the  bidirectional 
nature  of  the  coupling  between  the  systems,  which 


Memory  u" 


System  1 


u"  Memory 


-o 


Memory 

m+l 

i,2 

Network 

f  \ 

System  2 

Figure  2:  Proposed  ILC-based  framework  for  iteratively 
improving  ID-HIL  fidelity.  This  figure  illustrates  a 
decentralized  approach  in  which  an  independent  ILC 
controller  is  utilized  for  each  coupling  signal. 


is  considered,  since  it  was  reported  to  be  a  widely 
used  algorithm  [44].  In  (6),  q  represents  the 
forward  time  shift  operator.  Due  to  their 
applicability  to  nonlinear  systems  and  wide  use 
[44],  PD-type  learning  functions  are  considered 
here,  e.g., 

«,-  ( t ) = u,-  ( q + *,<  ( q + *4  <  ( * )  -  <  ( *  - 1 )) 

(7) 

This  type  of  learning  functions  also  has  the 
advantage  of  not  requiring  a  model  of  the  system 
as  part  of  the  design  process  [45-54],  which  is 
particularly  suitable  for  the  ID-HIL  paradigm  and 
the  specific  goals  of  this  paper. 

This  ILC-based  framework  is  applied  to  each 
coupling  signal  independently.  In  this  framework, 
each  coupling  signal  has  its  own  ILC  controller 
(with  its  own  learning  function)  that  does  not 
communicate  with  the  ILC  controllers  of  the 
remaining  coupling  signals.  Through  such  a 
decentralized  approach,  scalability  could  be 
achieved;  i.e.,  the  method  would  be  easy  to  extend 
to  ID-HIL  setups  with  multiple  sites. 

IV.  CASE  STUDY  DESCRIPTION 

To  investigate  the  viability  of  the  framework 
described  in  Sections  II  and  III,  a  case  study  is 
performed  with  a  series-hybrid  Mine  Resistant 
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Table  1.  Vehicle  specification 


Component 

Specification 

Vehicle 

Hybridized  Mine  Resistant  Ambush 
Protected  All-Terrain  Vehicle  (M-ATV) 

Weight 

14,403  kg 

Payload 

1814  kg 

Frontal  Area 

5.72  m2 

Engine 

6.4L  V8  turbo-diesel:  260  kW 

Generator 

Permanent  Magnet:  265  kW 

Battery 

Lithium  Iron  Phosphate:  9.87  kWh 

Engine 


Engine 

power 


Generator 


Desired  E/G  power 


Drive  cycle 


Driver 


Throttle, 

brake 


Desired  battery 
power 


Generator  power 
Battery 

PMS  Battery0*^  6 

Voltage,  current 


Vehicle  speed 


Brake 

Vehicle 


Speed 

Torque 


Motor 

power 

Motor 


Figure  3:  The  overview  of  the  system  considered  in  this 
case  study. 


Ambush  Protected  All-Terrain  Vehicle  (M-ATV). 
Some  of  the  specification  of  the  vehicle  platform 
considered  is  summarized  in  Table  1 .  A  high-level 
overview  of  the  system  is  shown  in  Fig.  3.  Each 
shaded  area  in  the  figure  corresponds  to  a  different 
geographic  location,  and  the  dashed  lines 
represent  communications  over  the  network.  The 
engine  and  the  battery  are  the  hardware 
components,  whereas  the  rest  of  the  vehicle  is 
simulated. 

The  details  of  the  components  that  comprise 
the  system  are  given  next. 

The  Engine-in-the-Loop  Setup 

The  hardware  component  of  interest  for  this 
work  is  a  Navistar  6.4L  V8  diesel  engine  with  260 
kW  rated  power  at  3000  rpm  and  a  rated  torque  of 
880  Nm  at  2000  rpm.  It  is  intended  for  a  variety  of 
medium-duty  truck  applications  covering  the 
range  between  classes  IIB  and  VII,  and  features 
technologies  such  as  high  pressure  common  rail 
fuel  injection,  twin  sequential  turbochargers,  and 


Figure  4:  A  photo  of  the  engine-in-the-loop  testing  facility 


exhaust  gas  recirculation.  A  high-fidelity,  AC 
electric  dynamometer  couples  the  physical  engine 
with  the  simulation  models  in  real  time  and 
operates  in  speed  control  mode.  The  setup  can  be 
connected  to  Simulink  for  integration  with 
mathematical  models,  allowing  for  a  real-time 
hardware-in-the-loop  simulation.  This  connection 
is  achieved  through  an  EMCON  400  flexible  test 
bed  with  an  ISAC  400  extension  [55].  The  photo 
of  the  setup  is  shown  in  Fig.  4. 

Motor/Generator  Model 


The  motor  and  the  generator  are  modeled 
using  quasi-steady  state  efficiency  maps  under 
assumption  that  their  dynamics  are  much  faster 
than  vehicle  dynamics  and  transients  are 
negligible.  As  shown  in  Fig.  5,  the  efficiency  of 
the  electric  machine  (EM)  r/EM  is  expressed  as  a 
function  of  electrical  torque  TEM  (or  electrical 
Power  Pelec )  and  speed  coEM  : 

^rnech  =  ^eleWvi  J  ($) 

7eM  —  VeM  (  ® EM  ’  ^EM  )  ’  (9) 

^EM  =  ^EM  {^EM’^e lec  ),  (10) 


where  Pmech  is  mechanical  power  and  k  indicates 
the  direction  of  power  flow:  k  =  1  represents  that 
electrical  power  is  converted  to  mechanical  power, 
and  k  —  -1  means  that  the  mechanical  power  is 
converted  to  electrical  power.  Maximum  output 
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Figure  5:  Efficiency  contour  map  of  an  electric  motor 
superimposed  by  maximum  and  continuous  torque 


Figure  6:  bsfc  of  engine/generator  unit  obtained  by 
combining  engine  bsfc  and  generator  efficiency  and 
superimposed  by  optimal  operation  lines  of  the 
engine/generator  unit  and  the  engine  only 


torque  of  the  motor  Tmm  is  governed  between  the 
continuous  torque  curve  and  the  peak  torque  curve 
accounting  for  the  heat  index  a  as  follows: 

=«7con,  +(|-«)7'Pcak=  00 


EM 

T 

V  cont  J 


dt , 


(12) 


where  Tpeak  and  Tcont  are  the  peak  and  continuous 
torque  respectively,  and  these  torques  are  a 
function  of  the  motor  speed  (Fig.  7).  The  heat 
index  varies  from  zero  to  one  and  is  used  to 
emulate  the  change  in  the  torque  limit  based  on 
motor  temperature.  The  time  constant  rEM  of  180 
seconds  is  selected  in  Powertrain  systems  analysis 
toolkit  developed  by  Argonne  National 
Laboratory. 


Optimal  Engine/Generator  Operation 


The  best  efficient  operating  points  of 
engine/generator  combined  system  are  different 
from  the  best  engine-efficient  operating  points.  In 
a  series  hybrid  configuration,  the  attached 
generator  possibly  shifts  the  best  fuel  efficient 
operating  points  of  the  combined  system  to  other 
operating  points.  The  combined  system  brake 
specific  fuel  consumption  (bsfc)  map  is  obtained 


by  dividing  the  engine  bsfc  map  is  divided  by  the 
generator  efficiency  map.  The  bsfc  of  the 
engine/generator  unit  bsfceng/gen  can  be  calculated 
by  using 

bsfCeng/gen  bsfceng/rigen  .  (13) 

The  best  fuel-efficient  operating  line  is  then 
determined  by  searching  the  minimum  fuel 
consumption  point  for  any  given  power  demand. 
Figure  6  shows  the  combined  bsfceng/gen  and 
optimal  operation  line  of  the  engine/generator  unit 
which  is  used  in  this  study. 

The  Battery-in-the-Loop  Setup 

The  Battery  Testing  Laboratory  employed  in 
this  case  study  is  equipped  with  a  Bitrode  Model 
FTV 1  battery  cycler  that  has  a  voltage  range  of  0- 
60V  for  1-12  batteries  in  series,  offers  three 
current  ranges  (0-2A,  0-20A,  and  0-200A)  and  a 
10  ms  control  and  data  acquisition  rate.  A 
Cincinati-Sub-Zero  Model  ZPH-16-3.5-SCT/AC 
temperature  and  humidly  test  chamber  has  a 
volume  of  453  L  that  can  accommodate  a  battery 
pack,  and  offers  a  temperature  range  of  -45°C  to 
190°C,  and  a  humidity  range  of  10%  to  98%  RH. 

A  single  cylindrical  battery  of  A123  26650 
with  the  capacity  of  2.3  Ah  is  used  for  the  testing. 
The  voltage  and  current  of  the  single  cell  is  scaled 
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Figure  7:  The  battery  testing  laboratory 


up  to  represent  the  corresponding  values  for  the 
battery  pack. 

A  photo  of  the  battery  laboratory  is  shown  in 
Fig.  7. 

Vehicle  Dynamics  Model 

The  longitudinal  dynamics  of  the  vehicle  is 
calculated  by  using 

M  ^Vvch  -  F  -F  -F  -F  -F  114t 

iKzveh  ^  prop  1  RR  'WR  1  GR  1  brk  ’ 

where  Mveh  and  vveh  are  the  mass  and  velocity  of 
the  vehicle  respectively,  Fprop  is  the  propulsion 
force,  and  FRR  is  the  rolling  resistance  force 
expressed  by 

FRR  =  frM^8  COS  0,  (15) 

where  fr  is  rolling  resistance,  g  is  gravitational 
acceleration,  and  9  is  the  road  grade.  The  wind 
resistance  force  FWR  is  calculated  by  using 

1 

FWR  =~  Paired  AehVveh  ’  (16) 

where  p,m  is  the  air  density,  Cd  is  the  drag 
coefficient,  and  Aveh  is  frontal  area  of  the  vehicle. 
The  grade  resistance  force,  FGR  =  Mvehg  sin  0  ,  is 
set  to  zero  in  the  driving  cycles  in  this  study. 


Driver  Model 

The  driver  model,  which  takes  the  desired  and 
actual  vehicle  velocities  as  inputs,  is  a  PI 
controller  with  saturation  and  anti-windup. 

Power  Management  Strategy 

The  power  management  strategy  employed  in 
this  case  study  is  a  frequency  domain  power 
distribution  strategy  that  splits  the  total  power 
demand  into  low  frequency  and  high  frequency 
components.  The  low  frequency  demand  is  fed  to 
the  engine  for  a  smooth  operation,  whereas  the 
high  frequency  demand  is  fed  to  the  battery  for 
shallow  battery  operating  range. 

Figure  8  shows  the  structure  of  the  proposed 
strategy  consisting  of:  1)  FDPD  module;  2)  SOC 
regulation  module;  and  3)  mode  decision  module. 

The  FDPD  module  for  HEV  mode  determines 
the  engine/generator  power  demand  by  splitting 
total  power  demand  in  low  and  high  frequency 
ranges.  The  power  demand  before  deciding  a 
vehicle  mode  Pdmd,2  is  determined  by  following 
steps: 

if  P dmd,0  —  P thl  and  P d/nd. 0  P th2 

P dmd,l  Pdmd.O  "P  A P dmd 
else  if  Pdmd,0—Fth2 

P dmd,  1  P th2  TAP dmd 

else 

P  dmd,  1  A P dmd 

dP,  .. 

dmd, 2  p  —  P 

LF  t.  dmd  ,2  dmd,\ 

dt 


Figure  8:  The  schematic  diagram  of  FDPD  strategy 
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where  Pdmd.o  and  Pdmd.i  are  power  demand  for 
vehicle  propulsion  and  total  power  demand 
respectively.  Pthi  and  Pt/,2  are  threshold  power 
levels  for  HEV  mode  incorporated  with  load¬ 
leveling,  and  xLF  is  the  time  constant  of  a  low- 
pass  filter.  The  feedback  power  demand  APdmd  for 
the  battery  SOC  regulation  is  determined  through 
the  proportional-integral  (PI)  controller  using  the 
difference  between  the  reference  SOC,  SOCre/  and 
current  SOC 

A PdmJ  =  kp  •  ASOC  +  k,\  ASOC dt ,  (17) 

where  kp  and  kI  are  proportional  and  integral 
gain  respectively. 

The  mode  decision  module  determines  driving 
modes.  The  modes  change  between  an  electric- 
vehicle  (EV)  mode,  a  hybrid  electric  vehicle 
(HEV)  mode  and  a  performance  vehicle  (PV) 
mode  as  following: 

If  P  dmd, 2  —  P  thl 

Pdmd.i  = 0  ■  EV  mode 

if  P dmd, 2  —  P dmd,0  ~  P bait, max 

P dmd, 2  P dmd, 2  •  HEV  mode 

else  (P dmd, 2  '  P dmd, 0~  P batt.max) 

Pdmd,2  min(P eng.max,  Pdmd.O  ~  Phan, max  )•  PV 

mode 

where  Peng,max  and  Pbatt.max  are  maximum  available 
engine  power  and  battery  discharging  power 
respectively.  Consequently,  the  performance  of 
FDPD  strategy  is  determined  by  five  control 
parameters;  namely,  rLF  ,  Pthi,  Pth2,  kp  ,  and  k,  . 
These  five  parameters  are  determined  through 
model-based  multi-phase  optimization  process. 

System  Integration  through  the  Network 

The  components  described  above  were 
integrated  over  the  network  according  to  Fig.  3. 
All  the  communications  happened  over  the  local 
area  network  except  for  the  desired  battery  power, 
which  was  routed  through  an  off-campus 
computer  using  the  Internet.  This  communication 


Figure  9:  Packet  delays  observed  during  a  network 
characterization  test 


experienced  an  average  delay  of  about  70ms. 
Figure  9  shows  a  representative  illustration  of  the 
delays  that  the  packets  experienced  during  a 
network  characterization  test. 

The  ILC  Framework 

With  respect  to  Fig.  2,  the  variable  c, , 
described  the  desired  battery  power  on  the  battery 
side  of  the  Internet,  c,  2  described  the  same 
quantity  on  the  PMS  side,  and  el=c21-c11 
captured  the  error  between  the  two.  The  ILC 
framework  aimed  to  reduce  this  error  iteratively  to 
improve  the  fidelity  of  the  networked  simulation 
according  to  a  P-type  learning  function  of  the  form 

ur'(k)=u-(k)+k/-(k)  (is) 

V.  CASE  STUDY  RESULTS 

The  networked  vehicle  system  described  in 
Section  IV  was  simulated  using  a  portion  of  the 
aggressive  military  driving  cycle  Urban  Assault 
Cycle  [56].  Frequent  high  acceleration  and 
deceleration  events  create  aggressive  propulsion 
and  braking  situations.  The  velocity  profile  of  this 
driving  cycle  is  displayed  Fig.  10.  The  parameters 
of  the  FDPD  strategy  are  summarized  in  Table  3. 

The  trajectory  of  the  error  in  the  desired 
battery  power  through  the  ILC  iterations  is  shown 
in  Fig.  11.  The  figure  shows  that  after  15 
iterations,  the  proposed  approach  can  achieve 
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Figure  10:  The  speed  profde  of  Urban  Assault  Cycle.  The 
shaded  region  is  used  in  this  study. 


Table  3.  Optimized  variables  of  the  FDPD  strategy 


Variable 

Value 

Cut-off  frequency,  zLF 

0.205 

Threshold  Power  1,  PthI 

16.7  kW 

Threshold  Power  2,  P,h2 

116.7  kW 

Proportional  gain,  kP 

836203.7 

Integral  gain,  kj 

4537.0 

more  than  70%  reduction  in  the  coupling  variable 
error.  It  is  worth  noting  that  this  number  does  not 
represent  an  upper  limit  on  how  much 
improvement  can  be  achieved  with  this  approach, 
because  neither  the  ILC  gains,  nor  the  ILC 
learning  function  is  optimized  by  any  means. 
Nevertheless,  this  70+%  reduction  in  error  is  still 
representative  of  the  levels  of  improvement  in 
fidelity  that  can  be  achieved  using  the  proposed 
technique. 

Figure  12  illustrates  what  this  70+% 
improvement  means  in  terms  of  the  dynamics  of 


Figure  11:  ILC  performance 


x  104 


Figure  12:  Battery  power  as  a  representative  system 
response  to  illustrate  how  Internet  delay  can  affect  system 
dynamics  and  how  the  proposed  method  can  alleviate  its 
negative  impact 

the  system.  The  figure  illustrates  a  portion  of  the 
actual  battery  power  trajectory  and  compares  the 
dynamic  response  observed  without  and  with  the 
ILC  framework  to  the  dynamics  that  would  be 
observed  if  the  desired  battery  power  was  also 
communicated  over  the  local  area  network  with 
negligible  delays.  The  oscillations  that  are 
observed  in  the  response  due  to  the  Internet  delays 
can  be  significantly  attenuated  by  the  ILC 
framework,  improving  the  fidelity  of  the 
networked  simulation. 

These  results  highlight  the  merit  and  potential 
of  the  proposed  framework  to  improve  fidelity, 
and  encourage  the  further  development  of  this 
framework.  Some  specific  questions  of  interest  are 
what  the  system  requirements  are  for  the  proposed 
framework  to  work,  what  type  of  learning 
functions  are  best  suited  for  this  application,  how 
the  ILC  parameters  relate  to  system 
characteristics,  and  what  the  robustness  of  this 
approach  is  and  how  it  can  be  maximized.  In  terms 
of  robustness,  the  robustness  to  variations  in  the 
initial  conditions  when  actual  hardware  is 
introduced  and  the  robustness  to  variations  in  the 
network  delays  are  of  particular  importance. 
Potential  future  work  also  includes  an 
investigation  of  the  convergence  properties  and 
the  trade-offs  between  a  monotonic  convergence 
and  the  error  attenuation  performance. 
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VI.  SUMMARY  AND  CONCLUSIONS 

An  iterative  learning  control  based  framework 
has  been  developed  to  improve  fidelity  in  Internet- 
distributed  hardware-in-the-loop  simulation.  The 
framework  has  been  tested  using  a  case  study  that 
showed  that  more  than  70%  reduction  in  coupling 
variable  errors  can  be  obtained  with  the  proposed 
method.  The  results  imply  that  the  framework  can 
improve  the  fidelity  of  the  networked  simulation 
significantly,  and  encourage  further  development. 
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